Papers with computer science
NLP for Counterspeech against Hate and Misinformation (CSHAM) (2025.acl-tutorials)
Copied to clipboard
| Challenge: | tutorial aims to show how counterspeech is used to tackle abuse and misinformation by individuals, activists and organisations. |
| Approach: | tutorial aims to show how counterspeech is currently used to tackle abuse and misinformation . will also show how Natural Language Processing (NLP) and Generation (NLG) can be applied to automate its production. |
| Outcome: | The tutorial will bring diverse multidisciplinary perspectives to safety research . case studies from industry and public policy will be included . |
SEHY: A Simple yet Effective Hybrid Model for Summarization of Long Scientific Documents (2022.findings-aacl)
Copied to clipboard
| Challenge: | Abstractive approaches to extract salient sentences from long documents are not effective due to their size. |
| Approach: | They propose a simple yet effective approach that exploits the discourse information of a document to select salient sections instead of sentences for summary generation. |
| Outcome: | The proposed approach avoids full-text understanding and retains salient information given the length limit. |
Language Models as Inductive Reasoners (2024.eacl-long)
Copied to clipboard
| Challenge: | Inductive reasoning is a core component of human intelligence. |
| Approach: | They propose a task to induce natural language rules from natural language facts using natural language as representation for knowledge instead of formal language. |
| Outcome: | The proposed task surpasses baselines in both automatic and human evaluations. |
VenusFactory: An Integrated System for Protein Engineering with Data Retrieval and Language Model Fine-Tuning (2025.acl-demo)
Copied to clipboard
Yang Tan, Chen Liu, Jingyuan Gao, Wu Banghao, Mingchen Li, Ruilin Wang, Lingrong Zhang, Huiqun Yu, Guisheng Fan, Liang Hong, Bingxin Zhou
| Challenge: | Pre-trained protein language models have been used in protein engineering, but their adoption is limited due to data collection, task benchmarking, and application challenges. |
| Approach: | They propose a versatile engine that integrates biological data retrieval, standardized task benchmarking, and modular fine-tuning of PLMs. |
| Outcome: | The proposed engine integrates biological data retrieval, task benchmarking, and modular fine-tuning of PLMs. |
Enhancing Future Link Prediction in Quantum Computing Semantic Networks through LLM-Initiated Node Features (2025.coling-industry)
Copied to clipboard
| Challenge: | Quantum computing is rapidly evolving in both physics and computer science due to its potential to solve complex quantum physics problems and accelerate computational processes. |
| Approach: | They propose to initialize node features using LLMs to enhance node representations for link prediction tasks in graph neural networks. |
| Outcome: | The proposed method compared to traditional node embedding techniques on a quantum computing semantic network and demonstrated efficacy compared with other methods. |
Towards Reliable Agents: Benchmarking Customized LLM-Based Retrieval-Augmented Generation Frameworks with Deployment Validation (2025.naacl-industry)
Copied to clipboard
| Challenge: | Existing benchmarks for general-purpose RAG systems, such as CRAG, RGB, MultiHop-RAG, and CRUD-RAGG, are limited and lack a benchmark specifically tailored to evaluate frameworks. |
| Approach: | They evaluated OpenAI’s Assistants API versus a RAG assistant built with Langchain and deployed a system based on benchmark insights as a course assistant over a two-year span. |
| Outcome: | The proposed benchmarks show that domain-specific retrieval impacts response accuracy and highlight key challenges in real-world deployment. |
Classification of Moral Foundations in Microblog Political Discourse (P18-1)
Copied to clipboard
| Challenge: | a recent study shows correlation between political ideologies and moral foundations expressed in text . a moral foundation theory suggests that there are five basic moral values which underlie human moral perspectives . |
| Approach: | They propose to model the moral foundations of tweets by using an annotation framework . they propose to use policy frames to predict the morality of political tweets . |
| Outcome: | The proposed model can predict moral foundations of political tweets, the authors show . their model can be used to predict political slogans and political ideologies, they say . |
Citation Amnesia: On The Recency Bias of NLP and Other Academic Fields (2025.coling-main)
Copied to clipboard
| Challenge: | citation age is a key factor in determining whether older works are cited in scientific journals or not. |
| Approach: | They examine the tendency of NLP to cite older work across 20 fields of study over 43 years (1980–2023) . they put NLP’s propensity to citation older work in the context of these 20 other fields to see whether differences can be observed . |
| Outcome: | The trend is strongest in NLP and ML research (-12.8% and -5.5% in citation age from previous peaks) |
Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that domain-specific BERT models can be improved when in-domain data is used for pretraining. |
| Approach: | They propose to use Twitter and forum text as pretraining sources for two BERT models and use similarity measures to nominate in-domain data for pretraining. |
| Outcome: | The proposed method can be used to improve performance on downstream tasks by using in-domain data. |
Snapshot-Guided Domain Adaptation for ELECTRA (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing domain-specific knowledge of domain-related tasks is lacking in pre-trained language models. |
| Approach: | They propose a domain-adaptation method which can dynamically select domain-specific tokens and guide the discriminator to emphasize them, without introducing new training parameters. |
| Outcome: | The proposed method can capture domain-specific knowledge of domain-related tasks without introducing new training parameters. |
Medical Dialogue System: A Survey of Categories, Methods, Evaluation and Challenges (2024.findings-acl)
Copied to clipboard
Xiaoming Shi, Zeming Liu, Li Du, Yuxuan Wang, Hongru Wang, Yuhang Guo, Tong Ruan, Jie Xu, Xiaofan Zhang, Shaoting Zhang
| Challenge: | Existing medical dialogue systems have significant potential to simplify diagnostic procedure and reduce the cost of collecting information from patients. |
| Approach: | They analyze 325 papers from well-known computer science, natural language processing conferences and journals to find out the major challenges of medical dialog systems. |
| Outcome: | The proposed systems have been surveyed in the medical community but have not been evaluated from a technical perspective. |
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)
Copied to clipboard
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
| Challenge: | Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation. |
| Approach: | They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments . |
| Outcome: | The proposed model enables high-fidelity generation of synthetic user conversation. |
Measuring Fine-Grained Domain Relevance of Terms: A Hierarchical Core-Fringe Approach (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to measure fine-grained domain relevance are needed for downstream tasks in natural language processing. |
| Approach: | They propose to measure fine-grained domain relevance, defined as the degree that a term is relevant to a given domain. |
| Outcome: | The proposed method outperforms baselines and surpasses professional human performance. |
D3: A Massive Dataset of Scholarly Metadata for Analyzing the State of Computer Science Research (2022.lrec-1)
Copied to clipboard
| Challenge: | DBLP is the largest open-access repository of scientific articles on computer science and provides metadata associated with publications, authors, and venues. |
| Approach: | They extracted metadata from more than 6 million DBLP publications to create the DB3 Discovery Dataset (D3) . they found that computer science is a growing research field (15% annually), with an active and collaborative researcher community. |
| Outcome: | The DBLP Discovery Dataset (D3) can be used to identify trends in research activity, productivity, focus, bias, accessibility, and impact of computer science research. |
CARE: Extracting Experimental Findings From Clinical Literature (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing annotation schemas and datasets fail to capture real-world complexity and nuance of experimental findings. |
| Approach: | They propose a new annotation schema capturing fine-grained findings as n-ary relations between entities and attributes. |
| Outcome: | The proposed schema captures fine-grained findings as n-ary relations between entities and attributes. |
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)
Copied to clipboard
Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Tianwei She, Yuang Jiang, Irene Li
| Challenge: | Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear. |
| Approach: | They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science. |
| Outcome: | The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation. |
A Knapsack by Any Other Name: Presentation impacts LLM performance on NP-hard problems (2025.findings-emnlp)
Copied to clipboard
| Challenge: | EHOP is a collection of NP-hard optimization problems expressed in natural language . state-of-the-art LLMs solve textbook problems more accurately than their real-life counterparts, but they lack a truly robust reasoning mechanism. |
| Approach: | They introduce a dataset of everyday hard optimization problems (EHOP) which includes problem formulations found in computer science textbooks, versions dressed up as problems that could arise in real life, and variants with inverted rules. |
| Outcome: | The proposed dataset includes problem formulations found in computer science textbooks, versions dressed up as problems that could arise in real life, and variants with inverted rules. |
Formalizing Style in Personal Narratives (2025.emnlp-main)
Copied to clipboard
| Challenge: | Personal narratives are stories authors construct to make meaning of their experiences. lack of a formal framework for analyzing these stylistic choices. |
| Approach: | They propose a framework that formalizes style as patterns in linguistic choices authors make . they apply the framework to dream narratives including a case study on a war veteran . |
| Outcome: | The proposed framework formalizes style in personal narratives as patterns in linguistic choices . it shows verbal processes dominate over mental ones, and linguistic choice influences psychological states . |
ARIES: A Corpus of Scientific Paper Edits Made in Response to Peer Reviews (2024.acl-long)
Copied to clipboard
| Challenge: | Existing systems that can interpret complex writing feedback and edit documents in response are limited on the most demanding writing tasks. |
| Approach: | They propose to use peer feedback to revise scientific papers based on peer feedback . they provide labels linking each reviewer comment to the specific paper edits made by the author . |
| Outcome: | The proposed model fails to identify which edits correspond to a comment and the original paper. |
AVocaDo: Strategy for Adapting Vocabulary to Downstream Domain (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to fine-tune a language model with a large corpus in a general domain are suboptimal for downstream data when domain discrepancy exists. |
| Approach: | They propose to consider the pretrained vocabulary as an optimizable parameter . they add domain specific vocabulary based on a tokenization statistic . their method achieved consistent performance improvements on diverse domains . |
| Outcome: | The proposed method achieves consistent performance improvements on diverse domains. |
A Bird’s-eye View of Language Processing Projects at the Romanian Academy (L18-1)
Copied to clipboard
| Challenge: | a recent article outlines five projects that address contemporary Romanian language . the authors argue that a constant accumulation of human expertise is needed to develop complex projects. |
| Approach: | a new article gives a general overview of five AI language-related projects at the Romanian Academy . they focus on the creation of a contemporary Romanian language text and speech corpus and language related applications . |
| Outcome: | a new article gives an overview of five AI language-related projects at the Romanian Academy . the projects address contemporary Romanian language, as well as language related applications . |
The AI Doctor Is In: A Survey of Task-Oriented Dialogue Systems for Healthcare Applications (2022.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems have been surveyed in the medical community from a non-technical perspective, but a systematic review from . a rigorous computational perspective has to date remained noticeably absent. |
| Approach: | They analyze 4070 papers on task-oriented dialogue systems for healthcare applications and identify gaps in their analysis. |
| Outcome: | The proposed system-level implementation details remain limited or underspecified, slowing the pace of innovation in this area. |
M3AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset (2024.acl-long)
Copied to clipboard
Zhe Chen, Heyang Liu, Wenyi Yu, Guangzhi Sun, Hongcheng Liu, Ji Wu, Chao Zhang, Yu Wang, Yanfeng Wang
| Challenge: | Publishing open-source academic video recordings is an emerging approach to sharing knowledge online. |
| Approach: | They propose a multimodal, multigenre, and multipurpose audio-visual academic lecture dataset with human annotations for multimodal content recognition and understanding tasks. |
| Outcome: | The proposed dataset can be used for multiple audio-visual recognition and understanding tasks. |
PAPERMIND: Benchmarking Agentic Reasoning and Critique over Scientific Papers in Multimodal LLMs (2026.findings-acl)
Copied to clipboard
Yanjun Zhao, Tianxin Wei, Jiaru Zou, Xuying Ning, Yuanchen Bei, Lingjie Chen, Simmi Rana, Wendy H. Yang, Hanghang Tong, Jingrui He
| Challenge: | Existing benchmarks assess integrated and agent-oriented scientific reasoning in isolation . Existing systems assess integrated reasoning in isolated tasks . |
| Approach: | They propose a benchmark to evaluate integrated and agent-oriented scientific reasoning over research papers. |
| Outcome: | The proposed benchmark evaluates integrated and agent-oriented scientific reasoning over scientific papers. |
Annotated Corpus of Scientific Conference’s Homepages for Information Extraction (L18-1)
Copied to clipboard
| Challenge: | a corpus of scientific conferences contains homepages with annotations of important information . name of conference, abbreviation, place, submission, notification, camera ready dates are included . |
| Approach: | They propose a corpus that contains 943 homepages of scientific conferences with annotations of interesting information. |
| Outcome: | The proposed corpus contains 943 homepages of scientific conferences, 14794 including subpages . the results show that it can be used as a reference data set for this type of task. |
Executing Natural Language-Described Algorithms with Large Language Models: An Investigation (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have revolutionized the field of natural language processing and artificial intelligence, creating new SOTAs and reaching human-level language understanding performance on a series of tasks and benchmarks. |
| Approach: | They propose to use an algorithm test set sourced from Introduction to Algorithm to assess LLMs' code execution abilities. |
| Outcome: | The proposed model can execute programs described in natural language as long as no heavy numeric computation is involved. |
Modeling French Sign Language: a proposal for a semantically compositional system (L18-1)
Copied to clipboard
| Challenge: | Several studies have proposed linguistic models to describe sign languages, but none have succeeded to describe the specificities of SL. |
| Approach: | They propose a linguistic approach to formalize the sign language (SL) they propose to take into account linguistic properties of the SL while respecting constraints of a modelisation process. |
| Outcome: | The proposed model takes into account linguistic properties of the sign language while respecting constraints of a modelisation process. |
An “Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectives” (2023.emnlp-main)
Copied to clipboard
| Challenge: | Mental health conversational agents (a.k.a. chatbots) are widely studied for their potential to offer accessible support to those experiencing mental health challenges. |
| Approach: | They review 534 papers on building mental health-related conversational agents . they recommend a few recommendations to bridge the disciplinary divide . |
| Outcome: | The systematic review reveals 136 key papers on building mental health-related conversational agents with diverse characteristics of modeling and experimental design techniques. |
GRAD: Generative Retrieval-Aligned Demonstration Sampler for Efficient Few-Shot Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) enriches prompts with external information, but its reliance on static databases constrains adaptability and can result in irrelevant demonstrations. |
| Approach: | They propose a Generative Retrieval-Aligned Demonstrator (GRAD) that trains an LLM model to generate input-specific concise demonstrations. |
| Outcome: | The proposed model outperforms strong baselines on Qwen2.5-14B across mathematical reasoning and advanced STEM questions. |
VER: Unifying Verbalizing Entities and Relations (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a new model for verbalizing entities and relations is proposed to help understand entities and relationships . a unified model for Verbalizing Entities and Relations is proposed . |
| Approach: | They propose a model that takes any entity or entity set as input and generates a sentence to represent entities and relations. |
| Outcome: | The proposed model can generate sentences describing entities and relations . it can be used to explain entities and relationships, and to perform commonsense reasoning tasks . |
Exploring the Role of Mental Health Conversational Agents in Training Medical Students and Professionals: A Systematic Literature Review (2025.findings-acl)
Copied to clipboard
| Challenge: | This systematic review analyses 38 studies on AI-powered conversational agents in mental health education and training . traditional training methods provide valuable but expensive and inherently limited learning opportunities . early pioneers like Woebot and Wysa demonstrated a groundbreaking insight: machines could engage in meaningful therapeutic interactions. |
| Approach: | They analyse 38 studies on AI-powered conversational agents in mental health education and training . findings reveal that AI-based approaches dominate the field, with training as the application area being the most prevalent . |
| Outcome: | The systematic review of 38 studies on AI-powered conversational agents in mental health education and training (MHET) reveals that AI-based approaches dominate the field, with training as the application area being the most prevalent. |
A MISMATCHED Benchmark for Scientific Natural Language Inference (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for scientific NLI are derived from various computer science domains, whereas non-CS domains are completely ignored. |
| Approach: | They propose a scientific natural language inference benchmark called MisMatched that incorporates sentence pairs having an implicit scientific NLI relation into model training. |
| Outcome: | The proposed benchmark covers three non-CS domains and contains 2,700 human annotated sentence pairs. |
The ParlaSent Multilingual Training Dataset for Sentiment Identification in Parliamentary Proceedings (2024.lrec-main)
Copied to clipboard
| Challenge: | The paper presents a new training dataset of sentences in 7 languages, manually annotated for sentiment, which is used in a series of experiments focused on training a robust sentiment identifier for parliamentary proceedings. |
| Approach: | They propose to use a dataset of sentences manually annotated for sentiment to train a robust sentiment identifier for parliamentary proceedings. |
| Outcome: | The proposed model performs very well on languages not seen during fine-tuning and additional fine- tuning data from other languages significantly improves the target parliament’s results. |